Local measures of information storage in complex distributed computation
نویسندگان
چکیده
Information storage is a key component of intrinsic distributed computation. Despite the existence of appropriate measures for it (e.g. excess entropy), its role in interacting with information transfer and modification to give rise to distributed computation is not yet well-established. We explore how to quantify information storage on a local scale in space and time, so as to understand its role in the dynamics of distributed computation. To assist these explorations, we introduce the active information storage, which quantifies the information storage component that is directly in use in the computation of the next state of a process. We present the first profiles of local excess entropy and local active information storage in cellular automata, providing evidence that blinkers and background domains are dominant information storage processes in these systems. This application also demonstrates the manner in which these two measures of information storage are distinct but complementary. It also reveals other information storage phenomena, including the misinformative nature of local storage when information transfer dominates the computation, and demonstrates that the local entropy rate is a useful spatiotemporal filter for information transfer structure.
منابع مشابه
The local information dynamics of distributed computation in complex systems
Joseph Troy Lizier Doctor of Philosophy The University of Sydney October 2010 The local information dynamics of distributed computation in complex systems The nature of distributed computation in complex systems has often been described in terms of the component operations of universal computation: information storage, transfer and modification. This thesis makes the original contribution of a ...
متن کاملA framework for the local information dynamics of distributed computation in complex systems
The nature of distributed computation has often been described in terms of the component operations of universal computation: information storage, transfer and modification. We introduce the first complete framework that quantifies each of these individual information dynamics on a local scale within a system, and describes the manner in which they interact to create non-trivial computation whe...
متن کاملMeasuring information storage and transfer in swarms
Spatial aggregation of animal groups give individuals many benefits that they would not be able to obtain otherwise. One of the key questions in the study of these animal groups, or “swarms”, concerns the way in which information is propagated through the group. In this paper, we examine this propagation using an information-theoretic framework of distributed computation. Swarm dynamics is inte...
متن کاملEntropy-based Consensus for Distributed Data Clustering
The increasingly larger scale of available data and the more restrictive concerns on their privacy are some of the challenging aspects of data mining today. In this paper, Entropy-based Consensus on Cluster Centers (EC3) is introduced for clustering in distributed systems with a consideration for confidentiality of data; i.e. it is the negotiations among local cluster centers that are used in t...
متن کاملDetecting Non-trivial Computation in Complex Dynamics
We quantify the local information dynamics at each spatiotemporal point in a complex system in terms of each element of computation: information storage, transfer and modification. Our formulation demonstrates that information modification (or non-trivial information processing) events can be locally identified where “the whole is greater than the sum of the parts”. We apply these measures to c...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Inf. Sci.
دوره 208 شماره
صفحات -
تاریخ انتشار 2012